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We report an analytical study of the vibrational spectrum of the 
simplest model of jamming, the soft perceptron. We identify two 
distinct classes of soft modes. The first kind of modes are related to 
isostaticity and appear only in the close vicinity of the jamming tran¬ 
sition. The second kind of modes instead are present everywhere in 
the glass phase and are related to the hierarchical structure of the 
potential energy landscape. Our results highlight the universality of 
the spectrum of normal modes in disordered systems, and open the 
way towards a detailed analytical understanding of the vibrational 
spectrum of low-temperature glasses. 
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Significance The vibrational spectrum of glasses displays an 
anomalous excess of soft low-frequency modes with respect to 
crystals. Such modes are responsible for many anomalies in 
thermodynamic and transport properties of low-temperature 
glasses. Many distinct proposals have been formulated to un¬ 
derstand their origin but none of them results from the ana¬ 
lytic solution of a microscopically grounded model. Here we 
solve analytically the spectrum of a simple model that belongs 
to the same universality class of glasses, and identify two dis¬ 
tinct mechanisms that are responsible for the soft modes. 


Introduction — Low-energy excitations in disordered 
glassy systems have received a lot of attention because of their 
multiple interesting features and their importance for thermo¬ 
dynamic and transport properties of low-temperature glasses. 
Much debate has concentrated around the deviation of the 
spectrum from the Debye law for solids, due to an excess of 
low-energy excitations, known as the “boson peak” [1], 

The vibrational spectrum of glasses is a natural problem 
of random matrix theory. In fact, the Hessian of a disordered 
system is a random matrix due to the random position of par¬ 
ticles in the sample. The distribution of the particles induces 
non trivial correlations between the matrix elements. Many 
attempted to explain the observed spectrum of eigenvalues by 
replacing the true statistical ensemble with some simpler ones, 
in which correlations are neglected or treated in approximate 
ways [2, 3, 4, 5, 6, 7, 8, 9, 10, 11]. Yet most of these models 
are not microscopically grounded, thus making it difficult to 
asses which of the proposed mechanisms are the most relevant 
and understand their interplay. 

In this work we will focus on two ways of inducing a boson 
peak in random matrix models. First, it has been suggested 
that the boson peak is due to the vicinity to the jamming tran¬ 
sition where glasses are isostatic [12, 13]. Isostaticity means 
that the number of degrees of freedom is exactly equal to the 
number of interactions. Isostaticity implies marginal mechan¬ 
ical stability (MMS): cutting one particle contact induces an 
unstable soft mode, that allows particles to slide without pay¬ 
ing any energy cost [14, 15]. From this hypothesis, scaling laws 
have been derived that characterise the spectrum as a func¬ 


tion of the distance from an isostatic point [11, 16, 12]. Sec¬ 
ondly, it has been proposed that low-temperature glasses have 
a complex energy landscape with a hierarchical distribution of 
energy minima and barriers [17]. Minima are marginally sta¬ 
ble [18] and display anomalous soft modes [19, 11] related to 
the lowest energy barriers [20, 21, 22], We will denote this sec¬ 
ond kind of marginality as landscape marginal stability (LMS). 

Both mechanisms described above are highly universal. 
LMS is a generic property of mean field strongly disordered 
models [18]. MMS holds for a broad class of simple ran¬ 
dom matrix models [6, 10, 11, 16] and for realistic glass mod¬ 
els [12, 23, 24] at the isostatic point. Universality motivates 
the introduction of a broad class of Continuous Constraint 
Satisfaction Problems (CCSP) [25], in which a set of con¬ 
straints is imposed on a set of continuous variables. In the 
satisfiable (SAT) phase, all the constraints can be satisfied, 
while this is impossible in the unsatisfiable (UNSAT) phase. A 
sharp SAT-UNSAT transition separates the two phases: jam¬ 
ming can be seen as a particular instance of this transition. 
In fact, (i) jamming properties are within numerical precision 
super-universal, i.e. independent of the spatial dimension d 
for all d > 2 [26, 27], (ii) they can be analytically predicted 
through the exact solution in d —> oo [28, 17], and (in) the 
perceptron model of neural networks, a prototypical CCSP, 
displays a jamming transition with the same exponents [25]. 
Based on universality, both for analytical and numerical com¬ 
putations, the perceptron appears to be the simplest model 1 
where low-temperature glassy behaviour can be studied [25]. 

Here, we exploit this simplicity and characterise analyti¬ 
cally the vibrational spectrum of the perceptron at zero tem¬ 
perature in the glass phase. Our main results are: (i) the 
spectrum is given by a Marchenko-Pastur law with parameters 
that can be computed analytically; (ii) it closely resembles the 
one of soft sphere glass models in all d > 2; (Hi) it displays soft 
modes coming from marginal stabilities of both kinds (LMS 
and MMS), allowing us to unify both contributions and un¬ 
derstand their interplay. Our results are based on the replica 
method and random matrix theory, and for the first time we 
are able to derive all the critical properties of jamming within 
the analytic solution of a well-defined microscopic model. 


Reserved for Publication Footnotes 


1 There is of course the possibility of a weak dependence of the jamming exponents on d In that 
case our results would be exact only for d —^ oo, yet they can be expected to provide a very good 
approximation in d < oo. 
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The model — We propose to use the perceptron as a min¬ 
imal model for jamming. In doing that we heavily rely on a 
universality hypothesis. Rather then looking for physical re¬ 
alism, we posit that we can capture many of the interesting 
features of low-energy excitations in the glass phase close to 
jamming making abstraction of the following three basic prop¬ 
erties of particle systems: (a) the relevant degrees of freedom, 
the particle positions, are continuous variables; (b) in hard 
spheres, impenetrability can be seen as a set of constraints - 
inequalities- on the distances between spheres; (c) spheres can 
be made soft by relaxing the impenetrability constraint and 
imposing a harmonic energy cost to any overlaps [12]. 

Let us now introduce a general class of CCSP where a set 
of N continuous variables x = {* 1 , ...,a:jv} is subject to a set 
of M constraints of the form h tl {x) > 0 (/i = 1 • • • M). The 
“hard” version of the problem corresponds to allowing only 
configurations that satisfy the contraints; the “soft” version 
corresponds to giving an energetic penalty to each violated 
constraint. This can be encoded in an energy, or Hamiltio- 
nian, or “cost” function * 2 

M 

m = £ - ^> 2 £(-m- [i] 

11=1 

where 9(x) is the Heaviside function. For all configurations 
x, one obviously has H[x\ > 0. There are thus only two pos¬ 
sibilities: either all the constraints can be satisfied and the 
ground state energy is Hgs = 0 (SAT phase), or Hgs > 0 
(UNSAT phase). These two phases are separated, in the ther¬ 
modynamic limit N —> 00 , by a sharp SAT-UNSAT phase 
transition [29]. The hard case corresponds to e = 00 , and the 
UNSAT phase is then forbidden. 

Particle systems correspond to a special choice: the Xi are 
d-dimensional vectors confined in a finite fixed volume; each 
constraint is the “gap” between two given particles, so it has 
the form = \xt — Xj\ — a, where a is the particle diam¬ 
eter; the index /r = {i < j} takes M = N(N — l)/2 values 
corresponding to all possible particle pairs. Plugging this in 
Eq. [ 1 ] the reader will immediately recognize the soft sphere 
Hamiltonian used in most studies on jamming [12, 30]. Be¬ 
cause jamming is the point where the energy first becomes 
non-zero upon increasing a , we can identify it with the SAT- 
UNSAT transition for this special choice of the constraints. 

The spherical perceptron is probably the simplest abstract 
CCSP where, appropriately rephrased, the three ingredients 
above are combined [25]. The variables x belong to the uni¬ 
tary IV-dimensional sphere with JA a: 2 = 1, and one considers 
M = aN constraints of the form 

• x - a > 0 , [2] 

defined in terms of vectors, composed by 

quenched i.i.d. random variables with independent ./V(0,1) 
components. The control parameters of the system are thus 
a and a, and jamming defines a line in the (a, a) plane sepa¬ 
rating the SAT and UNSAT phases. The sign of a is crucial: 
for a > 0 the perceptron is a convex CCSP, with a unique en¬ 
ergy minimum [31, 32]; for a < 0 the problem is non-convex 
and multiple minima are possible [25]. 

In the following, (•) indicates an average on the minimum 
energy configurations for a given realisation of quenched dis¬ 
order (i.e. of the £ M ) while (•) indicates an additional average 
over the disorder. We will also introduce a special notation 
for (a times) the average moments of the gap distribution in 
a given configuration, 

1 M 

[ h n ] = jjY,K0(-K)- [ 3 ] 

M=1 


For future reference, it is useful to provide a simple dic¬ 
tionary between physical quantities in particles systems and 
in the perceptron. The energy is clearly identified with 
H oc [h 2 ] in both cases. The pressure is proportional to 
dH/da oc [h] in particle systems, and the same definition can 
be used for the perceptron. The gaps between pair of parti¬ 
cles correspond to the constraints The forces, which act 
from a constraint fi to a variable i, are naturally defined as the 
^-contribution to the total force Fi = —dH/dxi acting on Xi, 
namely, fj J ' = —(dh^/dx^h^d^—h^). The total number of 
contacts in spheres is the number N[ 1] of violated constraints 
with hn < 0; one can keep the same definition for the percep¬ 
tron. In the following we will approach jamming from the 
UNSAT phase, where [ h n ] —> 0 from non-zero values 3 for all 
n > 0, while, for continuity, [1] tends to the fraction of bind¬ 
ing constraints, i.e. those such that = 0. The isostaticity 
condition is that the number of binding constraints equals the 
number of degrees of freedom and can be therefore written as 
[1] = 1. As already mentioned, a and a play the role of con¬ 
trol parameters that are analogue to the packing fraction in 
the sphere problem. In addition the Debye-Waller factor 
corresponds to the Edwards-Anderson parameter (see below 
and [28]). Finally, note that rattlers, i.e. particles that at 
jamming are involved only in non-binding constraints, cannot 
exist in the perceptron, because each variable Xi is connected 
to all the constraints. 


Vibrational spectrum — We now present our main tech¬ 
nical result which is the exact computation of the eigenvalue 
spectrum of the Hessian of H[x] in its points of minimum 
(we now choose e = 1). We enforce the spherical constraint 
through a Lagrange multiplier £ and consider the modified 
Hamiltonian [*] = H[x] — ^<^{x 2 — 1). The first order min¬ 
imization conditions read 


dH c 

dxi 


M 

- NCxi = 0 . 

fl=l 


[4] 


Multiplying by Xi and summing over i we can obtain a re¬ 
lation between £ and the distribution of the gaps h,, in the 
minimum, namely C = w + ^h ll )9(-h ll ) = [h 2 ] + a[h\. 

The Hessian matrix, normalized with N reads: 


1 q2 tt -I M 

M » = Nmdr -< 4 «' t 5 ' 

11=1 

Notice that in the SAT phase, all the gaps are positive and 
both () and the elements of M are trivially equal to zero. We 
concentrate therefore on the UNSAT phase, where there is a 
non vanishing fraction [1] of negative gaps h 

In principle in the point of minima of H, and 9(—h^) 
that appear in Eq. [5] could be effectively correlated, how¬ 
ever to the leading order in large N these correlations can be 
neglected, because each h^ is the sum of a large number of 
. The matrix M is thus equivalent to a random matrix from 
a modified Wishart ensemble [33], with an effective number 
of random contributions equal to 2V[1] and a constant term £ 
added on the diagonal: 

, JV[1] 

Mu — V $$ - c = I nr.,. - c Sn , [e] 

/z=l 


^Note that the choice of the exponent 2 in Eq. [ 1 ] is arbitrary but corresponds to the common 

choice of a soft harmonic repulsion in the context of sphere packings; other exponents can be chosen 
and the results remain qualitatively similar, see [12]. 

3 All the moments [h n \, including n = 0, are clearly equal to zero in the SAT phase. 
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Fig. 1. (Main panel) Phase diagram of the model. The R5B region is delimited by 
the dashed blue line, a < 0 and a > Cr c (cr). The jamming line a j (rx) that sepa¬ 
rates the SAT from the UNSAT phase, as estimated by the RS solution Eq. [13], is 
depicted as a full red line. The exact ctj(rx) should be computed within the fullRSB 
ansatz for cr < 0, but we expect only a small difference as confirmed in Fig. 3. 
(Inset) The density of contacts [1] along the jamming line. Jamming is isostatic 
([1] = 1) for cr < 0 and hypostatic ([1] < 1) for rx > 0. 


Thermodynamic analysis: the convex domain — Ther¬ 
modynamic and disorder averages can be computed with the 
aid of the replica method [18]. The partition function is writ¬ 
ten as an integral over a certain number of copies of the sys¬ 
tem, the average of the disorder is taken and the resulting inte¬ 
gral is evaluated through the saddle-point method for N —> oo. 
As a result, one should minimize a free-energy which is a func¬ 
tion of the average overlap between replicas, q a b = (x a ■ x b ) 
(i q aa = 1 due to the spherical constraint). The minimiza¬ 
tion is not possible for a generic matrix q a b and one has thus 
to make an ansatz on the structure of the matrix minimizer, 
that codes for the organization of the ergodic complonent in 
the system [18]. If ergodicity holds and there is a single com¬ 
ponent, the replica symmetric (RS) q a b = q for a ^ b ansatz 
is appropriate. The RS free energy for the perceptron is [31] 


m T 

Frs = "2" 


i°g(i - q) + 


1 -q 


[9] 


aT J D q (h + a) log D 1 - q (y - h) e Pv 0( v)/2 ^j 


where Wij = (IV[1]) 1 12^=1 is a standard Wishart ma¬ 
trix [34] with “quality factor” Q = 1/[1[. It follows that for 
large N the eigenvalue spectrum of M obeys the modified 
Marchenko-Pastur (MP) law [35] 


n t\\ _ f (1 — [ 1 ])< 5 (^ + 0 + [ 1 ] < 1 

p[A > ~ \ v{\) [1] > 1 


i/(A) 


1 y/(A — A_)(A+ — A) 
27t A + <(" 


1a_,a + (A) , 


a± = (v^il ± I ) 2 - C • 


[7] 


This result is very general: for any minimum of H, Eq. [7] 
holds for specific values of the parameters [1] and Also, 
the eigenvectors of Wishart matrices are delocalized [36] and 
are asymptotically distributed according to the uniform Haar 
measure on the sphere. The same properties hold for the 
eigenvectors of the Hessian of the perceptron. We will see 
that Eq. [ 7] reproduces all the known features of low-energy 
excitations close to jamming: its main virtue is to relate these 
features to a few characteristics of the gap distribution. 

The condition of minimum of H requires that all the eigen¬ 
values of the spectrum are positive or zero. For [1] < 1, this 
implies < 0, which can only happen if a > 0. Thus for 
a < 0, necessarily [1] > 1. In that case we need A_ > 0, i.e. 


(a/W-1 ) 2 >C=[h 2 ]+a[h\. [8] 

Equality in Eq. [8] corresponds to a marginally stable min¬ 
imum whose spectrum touches zero. It also implies that at 
jamming, where [h] and [h 2 ] vanish and [1] tends to the num¬ 
ber of binding constraints, marginally stable minima are nec¬ 
essarily isostatic with [1] = 1. Note that in the context of 
sphere packings, Eq. [8] translates into a relation between 
the excess of contacts 5z ~ [1] — 1 and the pressure p ~ [h], 
which reads Sz 2 > Const, x p and has been derived in [14]. 

We now need to compute the moments [ h n ] that enter in 
Eq. [7]. Unfortunately, this computation cannot be done an¬ 
alytically for a single minimum or a single sample. Instead, we 
are able to compute the average ([/i n ]) over all the absolute 
minima of the Hamiltonian. Because the moments [h n ] are 
self-averaging for large N, this provides information over the 
typical absolute minima of the Hamiltonian as a function of 
the control parameters (a, a). In the following paragraphs we 
report the computation of ([ h n ]); for simplicity, unless other¬ 
wise specified we drop the averages and replace ([/i™]) —> [h n ]. 


where D q (h) = dh exp[—h 2 /(2q)]/y/2nq and D(h) = D\(h). 
This expression must be minimized with respect to q. 

We have two distinct situations when T —> 0. (i) in the 
SAT phase, because there are many solutions, different repli¬ 
cas can be in different solutions and q < 1 at T = 0 [31]: from 
Eq. [ 9 ] one can show that the ground state energy is Eq = 0. 
(ii) in the UNSAT phase, the replicas are in the unique abso¬ 
lute energy minimum and q = 1 at T = 0. For T — > 0, due to 
harmonic vibrations, q = 1 — + 0(T 2 ). The limit T —> 0 

must therefore be taken with q —F 1 and x = {3(1 — q) fixed. 
The parameter x diverges approaching the SAT-UNSAT tran¬ 
sition from the UNSAT phase, while q —> 1 approaching the 
transition from the SAT phase. 

Let us now focus on the UNSAT phase. Evaluating the 
most internal integral by saddle point one finds 

= W = + 5 + 1101 


and optimizing over \ gives the equation 




D(h + o)h 2 . 


Also, one can show that 


[hi 


a 

(1 + x) n 



D(h + a)h n . 


Jamming is the point for which x —> oo, or 



D(h + o)h 


-l 


[ 11 ] 


[ 12 ] 


[13] 


which coincides with the result of [31]. Also, 1 /x oc t van¬ 
ishes linearly in the distance t from the line aj S (cx), and from 
Eqs. [11] and [12] we obtain that Eq = [h 2 ]/ 2 = l/(2x 2 ) oc 
e 2 vanishes quadratically [12, 30]. We can thus identify the 
line aj S (cr) with the jamming transition, because Eq > 0 for 
a > aj S (cr) while Eq = 0 for a < aj S (cr). From Eqs. [12] 
and [13] we get [1] < 1 on the jamming line (Fig. 1), where 
the system is thus hypostatic and not critical [25]. 

From Eq. [12] we can compute the moments that enter 
in Eq. [7]. Recall that the RS solution implies a unique min¬ 
imum of the energy, so the average ([ft™]) coincide with the 
value of [h n ] in the absolute minimum. In the UNSAT phase 
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for a > 0 we get: (i) for large a, [1] > 1 and A_ > 0: the 
spectrum is gapped; (ii) for a > aj S (<r), A_ > 0 and [1] < 1 
with £ < 0: the spectrum is gapped and it has 1 — [1] modes 
with eigenvalue A = — £ > 0; (in) the same remains true at 
jamming for a > 0 and a = aj S (<r), except that the 1 — [1] 
modes vanish trivially because £ = 0. When a —> 0, A_ oc a 2 
vanishes so the gap closes on the line cr = 0. 

Finally, one can study the stability condition of the RS 
solution by considering a small perturbation of the matrix q a b 
and checking if this perturbation lowers the free energy. A 
standard computation [37, 32] leads to the stability condition. 
In the SAT phase where q < 1, the RS stability condition is 
a < a c (a) as computed in [25]; the line a c (a) falls in the SAT 
region for a < 0. In the UNSAT phase, we get the condition 

1 \ 2 rO 

! + - >[!] / D(h + a)(h 2 — 1) > 0 , [14] 

which is verified for a > 0 while it is violated for cr < 0. 

In summary, for a < 0 and a > a c (cr) the RS solution 
is unstable (as depicted in Fig. 1) and one must consider a 
solution for q a b that is not invariant under permutation sym¬ 
metry, usually denoted a replica symmetry breaking RSB so¬ 
lution [18]. Where the RS solution is correct, the spectrum is 
gapped. 

Thermodynamic analysis: the non-convex domain — 

In the region of non convex optimization a < 0, ergodicity is 
broken at low temperatures and large a. The RS solution is 
unstable and the structure of the matrix q a b is parametrized 
by a function q(x) defined in the interval x £ [0,1], which 
encodes the values of the overlaps of replicas that populate 
different metastable states of the system. This is called a full 
replica symmetry breaking (fullRSB) ansatz [18]. In particular 
this implies that at T = 0 there are many quasi-degenerate 
minima of the Hamiltonian. The value of g(l) = qea is the 
Edwards-Anderson order parameter that describes the over¬ 
lap of replicas confined in the same metastable state. The 
fullRSB equations for the perceptron have been written e.g. 
in [38]. In general they can only be solved numerically, but 
the scaling around the jamming transition can be obtained 
analytically [28, 17, 25]. Here we discuss the main results of 
this analysis, a detailed derivation will be reported elsewhere. 

As in the RS case, qea = 1 — yT in the UNSAT phase 
with x — > oo at the jamming transition. The jamming line 
falls in the fullRSB region for all a < 0 (Fig. 1) and can 
thus be computed numerically solving the fullRSB equations 
at T = 0; however, we expect a small difference with the RS 
computation, and in general the RS result is an upper bound, 
aj'iiRSB(o-) < aj S (a), so we did not perform the fullRSB 
computation. Let us call once again e the distance from the 
jamming line. Combining the results of [28, 17, 25] with orig¬ 
inal results derived in this work, the following properties can 
be obtained analytically for t —> 0: 

(a) the system is isostatic with [1] = 1 identically for all a < 0 
and a = aS ullRSB (a); 

(b) in the UNSAT phase y ~ £ -1 ^ 2 ; the average energy van¬ 
ishes at jamming as ( H) oc [h 2 ] oc e 2 ; the average gap is 
[/i] oc e; and the excess of contacts above the isostatic value 
is [1] — 1 ~ e 1 / 2 ; 

(c) in the SAT phase, the Edwards-Anderson order parameter 
behaves as 1 — (Jea ~ e re ; 

(d) at jamming (e = 0) the probability distribution of the gaps, 
defined as g(h) = Prob(/i ,i = h) satisfies g(h) ~ h 1 for 
h —¥ 0 + , while the distribution of absolute values of the 
forces satisfies P(f) ~ f° for / — ¥ 0 + ; 



Fig. 2. Spectrum of the Hessian for N = 1600, a = 4 and cr = 0.5, 0, —0.3, 
averaged over 208 samples, in linear (main panel) and semilog (inset) scales. The 
MP law given in Eq. [ 7 ] with RS parameters (full lines) perfectly reproduces the data 
for cr > 0, while deviations are observed for cr < 0, where instead a MP law with 
C = 0.037 and [1] = (1 + Vf ,) 2 = 1-42 (hence A_ = 0 and A+ = 4.76) 
perfectly fits the spectrum (dashed line). 



a 


Fig. 3. (a) The combination A_ = (y^iTJ — l) 2 — ([^ 2 ] + £r[/l]) as a 
function of cr for Q; =4 and several N, averaged over 100 samples. In the ther¬ 
modynamic limit this tends to the edge of the spectrum of the Hessian. Stability 
requires A_ > 0 for Af —>■ oo. For cr > 0, A_ tends to values greater than 0 
that coincide with the analytical RS result (full line). For cr < 0 the data indicate 
marginal stability, A_ —> 0 for Af —>■ oo. (b) The moments ([1] — l) 2 , [h] 
and y/lh" 2 ] as a function of cr for o; = 4, = 1600 (points with dashed lines 

as guides to the eye). Full lines are the RS predictions. While deviations between 
theory and simulations are observed in the behaviour of [1], there are no apprecia¬ 
ble differences for [h] and [h?\. As predicted by the theory these quantities vanish 
linearly at the jamming point estimated here at crj Pi —0.409, which is very well 
approximated by crj^ = —0.405234. 

(e) the values of the critical exponents k, = 1.41574 ..., 7 = 
0.41269 ..., 9 = 0.42311... are obtained analytically and 
coincide with the ones of soft spheres in mean field. 

We can next focus on the spectrum and compute A_ and £ 
that appear in Eq. [ 7 ]. We obtain that 


4 In technical terms, A_ = 0 is equivalent to the vanishing of the replicon mode of the fullRSB 
free energy. 
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(f) A_ vanishes identically in the fullRSB phase, because the 
condition A- = 0 coincides with the LMS condition 4 . 
Hence, in the fullRSB UNSAT phase, the spectrum is 
p(A) ~ V\/{\ + £) for small A and energy minima are 
marginally stable. 

(g) £ is positive in the UNSAT phase but it goes to zero, as ex¬ 
pected, at the jamming transition. Therefore, at jamming 
p(A) ~ 1/vA has a much larger density of soft modes. 
Slightly away from jamming, p(A) ~ \f\ for A < (, then 
reaches a maximum p(A ~ Q ~ l/t/C and then decreases 
as p(A) ~ 1/VA for A » 

We thus identify two distinct contributions to soft modes: the 
fullRSB structure (LMS) induces marginality with p(A) ~ %/A 
while the proximity to jamming (MMS) induces a much 
stronger contribution with p(A) ~ 1/%/A. 

Note that although each of points (a)-(g) has been derived 
separately through scaling arguments or numerically [12, 14, 
20, 13, 15, 16, 11, 17, 28], here for the first time we derive all 
of them in a unified way from the analytical solution of a well 
defined microscopic model. 


Comparison with numerical data — The results of 
the previous section can be compared with the numeri¬ 
cal minimization of the soft perceptron Hamiltonian given 
in Eq. [1]. To obtain numerically the minima of H, 
we use the following procedure. We start from a ran¬ 
dom assignment xq of the variables and we use the rou¬ 
tine gsl_multimin_fdfminimizer_vector_bfgs2 of the GSL 
library [39], that uses the vector Broyden-Fletcher-Goldfarb- 
Shanno (BFGS) algorithm to minimize a function. To im¬ 
plement the spherical constraint, we minimize Ha[x\ = 
H\x/\x^ + A(x 2 — l) 2 , where A is an irrelevant number of 
order 1. Note that this algorithm produces local minima that 
do not necessarily coincide with the absolute ones in the non- 
convex domain cr < 0. Therefore, the equilibrium calculation 
should not necessarily provide exact results for the minima 
that we produce numerically, however, the differences -if any- 
between the minima found numerically and the theoretical 
expectations for the absolute ones are very small. This is 
probably due to the fact that we work in a regime of fullRSB 
where relevant metastable states have energy density equal to 
the one of the ground state [18]. 

In Fig. 2 we report the spectrum computed numerically 
and we compare it with the theoretical prediction. As ex¬ 
pected, in the RS phase the absolute minimum is unique and 
can be easily found numerically. Hence, the theoretical pre¬ 
diction perfectly coincides with the analytical result. On the 
contrary, in the fullRSB phase the numerical algorithm gets 
stuck into local minima. Yet even in this case the spectrum 
is described by a Marchenko-Pastur law, which confirms that 
the result in Eq. [7] holds for all minima. Moreover, we 
find A_ = 0 suggesting that the local minima found by the 
algorithm are marginally stable. 

We checked the expected delocalization properties of the 
eigenvectors of the Hessian through the statistics of the inverse 
participation ratio, that for a given normalized eigenvector Vi 
is defined as y = vf, and is of order 0(1/N) for delo¬ 

calized eigenvectors. We found that the distribution of y is 
independent of a and a. Moreover, the average value of Ny 
tends to the value 3 implied by the Haar distribution on the 
sphere. 

In Fig. 3 we report the value of A_ = (%/[lJ— l ) 2 — {[h 2 ] + 
cr[h]), where the moments [h n ] are evaluated on the numeri¬ 
cally obtained minima. According to Eq. [7], this quantity 
should tend to the value of the edge of the spectrum A_ in 


the thermodynamic limit N —> oo. As expected, we observe 
that A_ is positive and follows the analytic RS prediction for 
a > 0, while for cr < 0 we observe that A_ —> 0 for N —> oo. 
Also, in Fig. 3 we report the moments ([1] — l) 2 , [h] and \J[h 2 ] 
as a function of cr in the UNSAT phase. As predicted by the 
scaling analysis of the fullRSB solution, these quantities van¬ 
ish linearly in e = a — aj where aj is the jamming point. We 
see therefore that all the regimes predicted by the theory are 
observed in numerical simulations. 


Characteristic frequencies and the boson peak — We 

now show that defining the frequency ui = %/A and the density 
of states D(lo) = p(A)^, our spectrum reproduces the salient 
features of the boson peak phenomenology as described in the 
introduction. Following [11], we define the characteristic fre¬ 
quencies uo* = %/Ci w o = %/A^ and uWx = %/A+, and from 
Eq. [7] we obtain 


D( W ) 


i to %/M - ug)MLtx ~ ^ 2 ) 

7T W 2 + Lol 


0J0 T T Wmax ■ [15] 


In the RS phase, we have wo > 0 and the spectrum is gapped, 
but in a d-dimensional, translationally invariant system one 
should see a Debye spectrum D(w) ~ uo d ~ 1 for lo < loo- For 
small ujq -C lo*, following [ 11 ], one expects in dimension d: 

{ M -1 UJ < Wo , 

w 2 /w 2 wo«w<w, , [16] 

flat 00* < UJ <C Umax , 


the phononic regime being absent for d —> oo and in the per¬ 
ceptron. For d = 3, D(w) displays a crossover between two oo 2 
regimes at loo, the second having a larger prefactor because 
lo * is small, which results in a boson peak [ 11 ], 

= 0 and thus loq = 0 


for a j <^Luj* , 
for LO* < 00 < W ma x 

[17] 

and the phonons should be completely hidden by the soft 
LMS excitations. Here lo* > 0 away from jamming, while 
lo* = vT ~ yja[h] ~ yfe when the distance from jamming e 
goes to zero. 

The result in [17] is fully consistent with the boson peak 
anomaly in the excitation spectrum of soft sphere packings 
as known from simulations and scaling arguments [12, 14, 40, 
23, 24, 11], confirming the super-universal behavior of glassy 
systems close to jamming. They are also fully consistent with 
the results of [ 11 ], with the advantage that here we can obtain 
a fully microscopic expression of the characteristic frequencies 
wo and lo*. 


In the LMS (fullRSB) phase, A_ 
identically. We get 


, 1 w 2 a/M ax - w 2 

= -5——2- 

7T LOT + LOZ 


UJ 

flat 


Conclusions — The soft perceptron is simple enough to al¬ 
low for a fully analytic characterization of vibrational spectra 
around UNSAT energy minima. While for any minimum of 
the Hamiltonian the spectrum has the form of a Marchenko- 
Pastur law, here we computed the parameters of this distri¬ 
bution only for the absolute minima. Super-universality of 
the jamming transition allows us to hypothesize that the pre¬ 
dicted form and parameter evolution of the spectrum cap¬ 
tures many of the low energy features of the spectrum of 
soft-sphere systems. We find two kinds of soft excitations, 
as described in [11], The first ones are related to the exis¬ 
tence of a complex energy landscape characterized by a mul¬ 
tiplicity of quasi-degenerate marginally stable minima. Due 
to this landscape marginal stability (LMS), the low-energy 
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spectrum is D(lo) ~ cu 2 . The second ones are related to 
the proximity to an isostatic jamming point, where the spec¬ 
trum is D(w) ~ oj 2 /( u! 2 + e). Hence, above a typical fre¬ 
quency w* ~ e 1 ^ 2 the density of states is flat, as found in 
soft spheres [12, 14]. Note that in particle systems the De¬ 
bye contribution of phonons to the spectrum scales as w d_1 , 
hence as soon as d > 3 the contribution of the LMS soft 
modes should overcome the one of phonons. In d — 3 the 
two contributions are of the same order, and therefore LMS 
modes might be mixed with phonons. Yet we think that 
LMS might explain why anomalous soft modes distinct from 
phonons, that are responsible for the plasticity of the glass, 
are observed in three dimensional soft sphere packings in the 
jammed phase for low frequencies uj < ui, in the boson peak re¬ 
gion [14, 20, 19, 21, 11, 22]. A way to test this idea would be to 
compute numerically the vibrational spectrum of soft spheres 
in d > 3 and investigate the evolution with d. Localized soft 
modes (e.g. the buckling modes discussed in [16, 27]) are also 
likely to emerge in finite dimensional systems and complicate 
the analysis. 

Let us stress once again that all of our results have been 
obtained analytically through the exact solution of a well de¬ 
fined model, and there is hope that they will be derived in 
a mathematically rigorous way in the future. Beyond their 
direct relevance for the physics of jamming, our results also 
open a new connection between jamming/packing problems 
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